An example of the difference between quantum and classical random walks 
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In this note, we discuss a general definition of quantum random walks on graphs and illustrate 
with a simple graph the possibility of very different behavior between a classical random walk and 
its quantum analogue. In this graph, propagation between a particular pair of nodes is exponentially 
faster in the quantum case. [MIT-CTP #3093] 
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Introduction. Many classical algorithms are based on 
random walks, so it is natural to ask whether quantum 
random walks might be useful for quantum computation. 
A framework for using quantum random walks to solve 
decision problems was investigated in 0|. There also, an 
exponential separation was found between the classical 
and quantum times to propagate through a certain tree. 

In this note, we describe a general definition of 
continuous- time random walks on graphs and give a sim- 
pler example of a graph for which the quantum time to 
propagate between a particular pair of nodes is exponen- 
tially shorter than the analogous classical propagation 
time. We also discuss advantages of the continuous time 
formulation over discrete versions. 

Random walks. A continuous time classical random 
walk on a graph is a Markov process. A graph is a set 
of V vertices {1,2,..., v} and a set of edges that specifies 
which pairs of vertices are connected in the graph. A 
step in a classical random walk on a graph only occurs 
between two vertices connected by an edge. Let 7 denote 
the jumping rate. Starting at any vertex, the probability 
of jumping to any connected vertex in a time e is (in 
the limit e ^ 0). This random walk can be described by 
the V X V infinitesimal generator matrix M defined by 

-7 a b, a and b connected by an edge 
Mab — { ^ a^b, a and b not connected (1) 
fc7 a = 6, fc is the valence of vertex a. 

If Pa(0 denotes the probability of being at vertex a at 
time t, then 



At 



^MabVhit). 



(2) 



Consider quantum evolution in a v-dimcnsional Hilbert 
space according to a Hamiltonian iJ. In a basis 
|1), |2), . . . , the Schrodinger equation for can 
be written 



.-{am)) ^Y.^a\Hmbm)) . 



(3) 



Note the similarity between (g) and (^. Whereas 
conserves probability in the sense that 



Y.Va{t)^l: 



(4) 



the Schrodinger equation preserves probability as the 
sum of the amplitudes squared: 



(5) 



In some sense, any evolution in a finite-dimensional 
Hilbert space can be thought of as a "quantum random 
walk." However, the analogy is clearest when H has an 
obvious local structure. 

A quantum random walk on a graph is naturally de- 
fined in a Hilbert space spanned by basis elements corre- 
sponding to the vertices. To respect the structure of the 
graph, we require that for a 7^ 6, 

{a\ll\b) 7^ iff a and b are connected by an edge. (6) 

This is a very weak requirement, so we can impose more 
structure on H . A natural quantum analogue to the clas- 
sical random walk described above is given by the quan- 
tum Hamiltonian with matrix elements 111 



{a\H\b) = Ma 



(7) 



Note that on a one-dimensional lattice, this results in the 
Hamiltonian defined by 



H\J) 
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2|j) + \j + 1)) : 



(8) 



which is just a discrete approximation to the operator 
—d^/dx^ (where A = 7~i/2 is the lattice spacing). 

The difference between the quantum and classical evo- 
lution comes from the i which appears in (^) but not in 
(^). This can result in radically different behavior, as 
seen in |l|. A simpler example is given next. 



An example. Here we define a sequence of graphs G„. 
The number of vertices in Gn is 2"+^ -f 2" — 2. In Figure |l| 
we show G4. In general, Gn consists of two balanced bi- 
nary trees of depth n with the 2" nth-level vertices of the 
two trees pairwise identified. 
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vertices in column j, that is, 



I col j) = 



^ aGcolumn j 



where 



2-' < j < n 
22«-j n<j<2n. 



(9) 



(10) 



In this basis, the non-zero matrix elements of H are 
(col j|H|colj±l) = -V27 (11 
(colj|i7|colj\-^ 27 J=0,n,2n 



87 otherwise. 



(12) 



which is depicted in Figure I (for 71 = 4) as a quantum 
random walk on a line with 2n + 1 vertices. 



FIG. 1. The graph G4. 

For both the classical and quantum random walks, we 
start at the root of one tree and want the probability as 
a function of time of being at the other root. In other 
words, we are interested in how long it takes to propa- 
gate from the leftmost vertex to the rightmost vertex as 
a function of n. 

Consider the classical case first. The vertices of G„ 
can be grouped in columns indexed by j G {0, 1, . . . , 2n}. 
Column contains the root of the left tree, column 1 con- 
tains the two vertices connected to that root, etc. Note 
that column n contains the 2" vertices in the middle of 
the graph and column 2n is the root at the right. 

To analyze the classical walk from the left root to the 
right root, we need only keep track of the probabilities of 
being in the columns. In the left tree, for < j < n, the 
probability of stepping from column j to column j + 1 
is twice as great as the probability of stepping from col- 
umn j to column j — I. However, in the right tree, for 
n < j < 2n, the probability of stepping from column j to 
column j -I- 1 is half as great as the probability of stepping 
from column j to column j — 1- This means that if you 
start at the left root, you quickly move to the middle of 
the graph, but then it takes a time exponential in n to 
reach your destination. More precisely, starting in col- 
umn 0, the probability of being in column 2n after any 
number of steps is less than 2~". This implies that the 
probability of reaching column 2n in a time that is poly- 
nomial in n must be exponentially small as a function of 
n. 

We now analyze the quantum walk on G„ starting in 
the state corresponding to the left root and evolving with 
the Hamiltonian given by (0). With this initial state, 
the symmetries of H keep the evolution in a {2n + 1)- 
dimensional subspace of the (2"+^ +2" — 2)-dimensional 
Hilbert space. This subspace is spanned by states |col j) 
(where < j < 2n), the uniform superposition over all 
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FIG. 2. The reduction of G4 to a quantum random walk 
on a line. Vertices correspond to columns and are labeled 
with the diagonal matrix elements of H/-y, whereas edges are 
labeled with its matrix elements between adjacent columns. 
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FIG. 3. Quantum random walk on an infinite, translation- 
ally invariant line. 

Starting at the leftmost vertex of Figure |^, there is an 
appreciable probability of being at the rightmost vertex 
after a time proportional to n. To see this, first consider 
quantum propagation on an infinite, translationally in- 
variant line of vertices as depicted in Figure Here it 
is straightforward to compute the amplitude to go from 
vertex I to vertex m in a time t (for example, see |2j): 

{m\e-'"'\l) = e-'^-'H'''~'j,n^i{2V2-ft) , (13) 

where Jm-i is a Bessel function of order m—l. This corre- 
sponds to propagation with speed 2V27. More precisely, 
for any e > and |m — ^| ^ 1, for t < ^ ^^^ — \m — l\, 

the amplitude is exponentially small in |m — ^|, whereas 
there are values of t between ( ^^^ )|to — l\ and ( ^^^ -I- 

e)\m — l\ at which the amplitude is of order |m — ^|~^/^. 

In the limit of large n, the reduced version of G„ is 
nearly identical to the infinite, translationally invariant 
line, so it is plausible that propagation on G„ will also 
occur with speed 2^/2^. To verify this, we numerically 
compute the probability |(col j\tp(t))\'^ of being in col- 
umn j at various times t, where |'0(O)) = |col 0) and we 
choose 7=1. This is shown in Figure with n = 500 for 



2 



t = 100, 250, and 400. These plots clearly show a wave 
packet which propagates with speed 2^/2, with the ampli- 
tude near the wavefront decreasing like In the first 
plot, a.t t = 100, the leading edge of the distribution is 
at column 200-\/2 « 283. The packet has not yet encoun- 
tered the small defect at the center, so it has a relatively 
simple shape. At t = 250, the wavefront has passed the 
center, and a small reflection can be seen propagating 
backward. However, the leading edge is relatively undis- 
turbed, having propag ated to column 500^2 « 707. The 
wavefront continues to propagate with speed 2^/2 until it 
reaches the right root, where the packet is reflected. The 
last plot, at i = 400, shows the distribution shortly after 
this first reflection. Even after the reflection, there is still 
an appreciable probability of being at the right root. 

The limiting distribution. In this section, we con- 
sider the distribution over the vertices after a long time. 
We emphasize that although the mixing times (the char- 
acteristic times to reach the limiting distribution) may 
be similar in the classical and quantum cases this is 
in no way indicative of similar dynamics, as the limiting 
distributions may be radically different. 

In the classical case, the limiting distribution is defined 

as 

TTb = lim pb{T) , (14) 

T — >oo 

which is independent of the starting state. It is easy to 
see that the limiting distribution on Gn is uniform over 
the vertices: this distribution is the unique eigenvector 
of M with eigenvalue 0, so it is the only component that 
remains after a long time. Thus tti, = (2"+^ + 2" — 2)^^ 
for each vertex b, which is exponentially small. 

In the quantum case, unitarity prevents the walk from 
reaching a steady state. However, a sensible definition 
of the limiting distribution, which depends on the initial 
state I a), is given by |^ 

X.= hm 1 r\{b\e-^"'\a)fdt. (15) 

T^oo 1 Jq 

This is the distribution resulting from a measurement 
done after a time chosen uniformly in [0,T], in the limit 
of large T. By expanding over the energy eigenstates 
\Er), we find 

Xb = Y.(^\^r){Er\a){a\Es){Es\b) 

r.s 

X lim - /^e~'(^'-^='*dt (16) 

T^oo T Jq 

= J2\(''\^r)\'mEr)\' (17) 
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FIG. 4. Propagation in G500 starting at the left root. From 
top to bottom, the times are t = 100, 250, and 400. 

(note that we have assumed Er ^ Eg for r ^ which is 
true for G„). In particular, consider the case where \a) = 
I col 0) corresponds to the left root and \b) — |col 2n) cor- 
responds to the right root. In this case, we may work 
in the reduced Hilbert space spanned by the columns, so 
the number of energy eigenstates is 2n + 1. By symme- 
try, |(col 0\Er)\ = |(col 2n\Er)\. The Cauchy-Schwartz 
inequality gives 
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J2\{colO\Er)\'J2^>(j2\{colO\Er.)\') =1, (18) 



which imphes 



^|(col 01^;^ 



> 



1 



2n + l 



(19) 



Thus in the hmiting distribution, the probabihty of being 
at the right root, starting at the left root, is 



Xcol 2n > 



1 



2n+ 1 



(20) 



which is much larger than in the classical case. 



Discussion. The model of quantum random walks used 
in this note applies automatically to any graph. In par- 
ticular, the Hamiltonian is determined by the local struc- 
ture of the graph and its definition does not require 
knowledge of any global properties. It is easy to imagine 
situations where the local structure of a graph is read- 
ily accessible, but determining some global property is 
difficult. For example, a computational problem may in- 
volve searching a graph for a node with a certain property 
whose presence or absence from the graph corresponds to 
the solution of an NP-complete problem 

The Hamiltonian-based approach to quantum random 
walks can be contrasted with discrete time models (for 
example, see ||^^|^) involving the extra state space of a 



"quantum coin." This extra label seems to be neces- 
sary in discrete time formulations of quantum random 
walks (and is provably necessary in the one dimensional 
case Q). However, for general graphs of mixed valence, 
it is not obvious how to define the discrete time unitary 
evolution operator without knowledge of global proper- 
ties of the graph. 
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